METHOD FOR CONTROLLING MULTITHREADING 
BACKGROUND OF THE INVENTION 



5 The present invention relates to multithreading, and ■ 

more particularly, to a method for controlling 

multithreading in a system that performs parallel processing' 
with multiple threads so as to increase the speed of 
programs and efficiently use system resources. 
10 In a system that executes programs, such as scientific 

calculations, threads are used to perform parallel 
processing. This increases the speed of programs. An 
operating system (OS) program generates threads in 
= g accordance with application programs. The OS allocates 

Tz 15 system resources to each of the generated threads and runs 

If? programs associated with the threads in a parallel manner. 

It takes time for the OS to generate a thread. Thus, 
once a thread is generated, the thread remains undeleted so 
?y that it can be used again. This increases the system 

;!? 20 processing speed. 

Q In more detail, when a thread completes execution of a 

program, the OS registers the thread as a standby thread in 
a table. Then, if there is a request for generating the 
thread, the standby thread registered in the table is used 
25 to run a program. This decreases the time for generating 

threads . 

In the prior art, all of the generated threads are . 
managed as standby threads. Thus, if the number of the 
running threads that are actually running is small, the 
30 system would have a large number of unnecessary standby 

threads. This wastes memory resources since system 
resources are allocated to the standby threads. 

For example, if 200 parallel threads are run at a 
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certain time, and then only two threads are run at a later 
time, 198 unnecessary standby threads would be occupying the 
memory. This is undesirable when operating a system that 
has low resources and would significantly affect the speed 
5 of other programs. 



SUMMARY OF THE INVENTION 



It is an object of the present invention to provide a 
10 method for controlling multithreading that increases the 

speed of running programs and uses system resources 
efficiently. 

^ To achieve the above object, the present invention 

Jr provides a method for controlling a plurality of threads 

^ 15 that perform parallel processing. The method includes 

CP monitoring a number of running threads performing parallel 

I" processing and a number of standby threads that are in a 

«■* standby state, and terminating standby threads in accordance 

fU 

fy with the number of the running threads and the number of the 

*:!? 20 standby threads. 

C3 The present invention also provides a controller for 

controlling a plurality of threads that perform parallel 
processing. The controller includes a thread management 
table for storing thread information of the plurality of 

25 threads. The thread information includes a number of 

running threads performing parallel processing and a number 
of standby threads that are in a standby state. Based on 
the number of the standby threads stored in the thread 
management table, a thread management circuit requests 

30 thread generation and a standby thread to run. A thread 

termination circuit terminates standby threads in accordance 
with the number of the running threads and the number of the 
standby threads stored in the thread management table. 
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The present invention further provides a computer 
readable storage medium storing a program for controlling a 
plurality of threads that perform parallel processing. The 
program performs a method including monitoring a number of 
5 running threads performing parallel processing and a number 

of standby threads that are in a standby state, and 
terminating standby threads in accordance with the number of 
the running threads and the number of the standby threads. 

Other aspects and advantages of the present invention 
10 will become apparent from the following description, taken 

in conjunction with the accompanying drawings, illustrating 
by way of example the principles of the invention. 
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BRIEF DESCRIPTION OF THE DRAWINGS 



The invention, together with objects and advantages 
thereof, may best be understood by reference to the 
following description of the presently preferred embodiments 
together with the accompanying drawings in which: 
™ 20 Fig. 1 is a schematic block diagram of a 

multithreading controller according to a preferred 
embodiment of the present invention; 

Fig. 2 is a schematic diagram of a thread management 
table of the multithreading controller of Fig. 1; 
25 Fig. 3 is an explanatory diagram of a thread control 

list of the thread management table of Fig. 2; 

Fig. 4 is a flowchart illustrating a routine for 
processing threads ; 

Fig. 5 is a flowchart illustrating a routine performed 
30 by a thread termination circuit of the multithreading 

controller of Fig. 1; and 

Fig. 6 is a schematic block diagram showing the 
hardware structure of the system. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS ■ 

Fig. 1 is a schematic block diagram of a 
5 multithreading controller 1 according to a preferred 

embodiment of the present invention." The multithreading 
controller 1 is incorporated in a system (computer) , which 
runs application programs, and requests an operating system 
(OS) 2 to generate threads. The controller 1. uses the 
10 generated threads to run program sections (e.g., DO loop or 

subroutines) in parallel. 
M When a thread completes running a program section, the 

multithreading controller 1 registers the thread as a 
= C standby thread. Subsequently, when there is a request to 

;i 15 perform the program section, the multithread controller 1 

Cft searches for the corresponding standby thread and, when 

ry 

finding the desired standby thread, runs the program section 
lf[ with the standby thread. If the desired standby thread is 

H T3? 

fjj not found, the controller 1 requests the OS 2 to generate a 

"~'20 thread. 

The multithreading controller 1 monitors the number of 
threads that are running program sections (hereafter 
referred to as running thread number) and the number of 
standby threads (hereafter referred to as standby thread 
25 number) . The multithreading controller 1 terminates the 

surplus standby threads when the standby thread number 
exceeds the number of necessary standby threads relative to 
the running thread number. The multithreading controller 1 
terminates standby threads based on, for example, a maximum 
30 running thread number and the standby thread number. 

In more detail, the multithreading controller 1 
monitors the running thread number for a predetermined time 
period, and sets the necessary number of standby threads to 
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the maximum value of the running thread number (maximum 
running thread number) taken during the time period. Then, 
the multithreading controller 1 compares the maximum running 
thread number with the currently managed number of standby 
threads. If the standby thread number is greater than the 
maximum running thread number, the multithreading controller 
1 terminates the excessive standby threads. In other words, 
the multithreading controller 1 decreases the standby thread 
number until it matches the maximum running thread number. 

In this manner, the multithreading controller 1 
decreases the standby threads that are using the system 
resources in a wasteful manner. Thus, the running threads 
are unaffected by surplus standby threads. 

The maximum running thread number varies in accordance 
with the operational state of the system. Hence, by 
terminating standby threads in accordance with changes in 
the maximum running thread number, the standby threads are 
managed at an optimal number with respect to the operational 
state . 

Since the number of standby threads correspond to the 
maximum running thread number, which is obtained by 
monitoring the running thread number over a predetermined 
time period, sudden increases in the number of threads can 
be handled. That is, even if the running thread number 
decreases momentarily, a number of standby threads 
corresponding to the maximum running thread number are 
stored. This avoids the termination of too many standby 
threads and enables programs to run immediately. 

The structure of the multithreading controller will 
now be discussed. 

The multithreading controller 1 includes a thread 
management circuit 11, a thread termination circuit 12, and 
a thread management table 13. 



The thread management circuit 11 requests the OS 2 to 
generate a thread and requests a thread to run a program. 
The thread termination circuit 12 monitors the standby 
threads and deletes surplus standby threads. 

Three threads 14, 15, 16, which have been generated by 
the OS 2, are illustrated in Fig. 1. The first two threads 
14, 15 are running threads, which run programs, and the 
third thread 16 is a standby thread, which has completed a 
program. 

Fig. 2 is a schematic ■ diagram of the thread management 
table 13. The thread management table 13 includes an 
information management table 21 and a plurality (three in 
association with the threads 14 to 16 in Fig. 1) of thread 
control lists 22, 23, 24. The information management table 
21 has a running thread queue section 21a, a standby thread 
queue section 21b, a standby thread counter section 21c, a 
running thread counter section 21d, and a maximum running 
thread counter section 21e. 

The running thread queue section 21a stores addresses 
of the thread control table lists that correspond to the 
queued running threads. Further, the running thread queue 
section 21a manages information concerning the running 
threads . 

The standby thread queue section 21b stores addresses 
of the thread control table lists that correspond to the 
queued standby threads. Further, the standby thread queue 
section 21b manages information concerning the standby 
threads. Accordingly, the running thread queue section 21a 
records the addresses of the thread control lists 22, 23 
associated with the running threads 14, 15, and the standby 
thread queue section 21b records the address of the thread 
control list 24 associated with the standby thread 16. 

Fig. 3 is an explanatory diagram illustrating the 
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structure of the thread control list 24. The other thread 
control lists 22, 23 have a structure similar to the thread 
control list 24 and will thus not be discussed. 

The thread control list 24 includes a thread running 
5 event control block (ECB) 24a and a thread terminating ECB 

24b. The thread running ECB 24a manages the requests 
received from the thread management circuit 11. The thread 
terminating ECB 24b manages termination requests received 
from the thread termination circuit 12 of Fig. 1. The 
10 standby thread 16 runs or stops a program in accordance with 

information written to the ECBs 24a, 24b. 
~~ The thread management circuit 11 stores a run request 

}4 in the thread running ECB 24a of the thread control list 24 

c p associated with the standby thread queue section 21b. When 

inni 

'}q 15 the run request stored in the thread running ECB 24a is 

l?l associated with the standby thread 16, the standby thread 16 

ru 

runs the program associated with the standby thread 16 in 
?s5s accordance with the information. 

ru 

[U The thread termination circuit 12 stores a termination 

Co 

request in the thread terminating ECB 24b of the thread 
Q control list 24 associated with the standby thread queue 

section 21b. When the termination request stored in the 
thread terminating ECB 24b is associated with the standby 
thread 16, the standby thread 16 is terminated. This frees 
25 the system resources that were allocated to the standby 

thread 16. 

The standby thread counter section 21c stores the 
number of standby threads counted by a standby thread 
counter (not shown) . The running thread counter section 21d 
30 stores the number of running threads counted by a running 

thread counter (not shown) . The maximum running thread 
counter section 21e stores a maximum value of the number of 
running threads counted by a maximum running thread counter 
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(not shown) . 

When the running threads 14, 15 complete the 
associated programs, the running thread counter decrements 
by one the value of the running thread counter section 21d 
for each of the running threads 14, 15. Further, the 
standby thread counter increments by one the value of the 
standby thread counter section 21c for each of the running 
threads 14, 15. 

When the standby thread 16 receives a run request from 
the thread management circuit 11, the value of the standby 
thread counter section 21c is decremented by one, and the 
value of the running thread counter section 21d is 
incremented by one. If the value of the running thread 
counter section 21d is greater than that of the maximum 
running thread counter section 21e, the standby thread 16 
updates the value of the maximum running thread counter 
section 21e to the value of the running thread counter 
section 21d. 

The thread management circuit 11 requests the 
generation or running of a thread based on the data of the 
standby thread counter section 21c. More specifically, when 
the thread management circuit 11 receives a request for 
running a parallel program, the thread management circuit 11 
requests the OS 2 to generate a thread if the value of the 
standby thread counter section 21c is null. The thread 
management circuit 11 queues the generated thread in the 
running thread queue section 21a and requests the thread to 
run a program. If the value of the standby thread counter - 
section 21c is one or greater, the thread management circuit 
11 requests the standby thread 16 queued in the standby 
thread queue section 21b to run a program. 

Based on the values of the standby thread counter 
section 21c and the maximum running thread counter section 
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21e, the thread termination circuit 12 deletes surplus 
threads. In other words, the thread termination circuit 12 
monitors the maximum running thread counter section 21e and 
the standby thread counter section 21c at predetermined time 
intervals and compares the values of the two counter 
sections 21c, 21e. If the value of the standby thread 
counter section 21c is greater than that of the maximum 
running thread counter section 21e, the thread termination 
circuit 12 terminates the standby threads until the number 
of the standby threads becomes equal to the value of the 
maximum running thread counter section 21e. More 
specifically, the thread termination circuit 12 requests 
termination of a number of standby threads exceeding the 
value of the maximum running thread counter section to 
recover system resources. 

The operation of the threads 14 to 16 and the thread 
termination circuit 12 will now be discussed. Fig. 4 is a 
flowchart illustrating a routine performed by a thread 
(running thread or standby thread) . 

When entering the routine, at step S31, the thread 
first increments the value of the running thread counter 
section 21d by one. 

At step S32, the thread compares the value of the 
running thread counter section 21d with the value of the 
maximum running thread counter section 21e. If the value of 
the running thread counter section 21d is greater than that 
of the maximum running thread counter section 21e, the 
thread proceeds to step S33. At step S33, the thread 
updates the value of the maximum running thread counter 
section 21e to that of the running thread counter section 
21d. 

At step S34, the thread runs a program. When the 
program is completed, the thread proceeds to step S35. 



At step S35, the thread decrements the running thread 
counter section 21d by one. Next, at step S36, the thread 
increments the value of the standby thread counter section 
21c by one. At step S37, the thread queues the 
corresponding thread control list in the standby thread 
queue section 21b. 

At step S38, the thread (standby thread) performs a 
multi-wait process. In the multi-wait process, the thread 
monitors the thread running ECB 24a and the thread 
terminating ECB 24b and waits until information is written 
to one of the two ECBs 24a, 24b. When information is 
written to the thread running ECB 24a or the thread 
terminating ECB 24b, the thread proceeds to step S39. 

At step S39, the thread determines whether the 
information written in step S38 is a termination request. 
If the written information is not a termination request, 
that is, if the information is a run request, the thread 
proceeds to step S40. At step S40, the thread increments 
the standby thread counter section 21c by one. The thread 
then returns to step S31. As a result, the thread functions 
as a running thread, which runs a program, and the standby 
thread is recycled. 

If the written information is a termination request in 
step S39, the thread proceeds to step S41. At step S41, the 
standby thread undergoes a termination process. This 
terminates (deletes) the standby thread. 

Fig. 5 is a flowchart showing a routine performed by 
the thread termination circuit 12. 

At step S51, the thread termination circuit 12 sets a 
timer to time a predetermined time. The predetermined time 
is the time period during which the values of the standby 
thread counter section 21c and the maximum running thread 
counter section 21e is monitored. The monitoring time may 
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be fixed in accordance with the system or varied in 

accordance with the operating time of the system. When the 

predetermined time elapses, the thread termination circuit 

12 proceeds to step S52. 

5 At step S52, the thread termination circuit 12 

compares the values of the standby thread counter section 

21c and the maximum running thread counter section 21e to 

determine whether the maximum running thread number is 

greater than the standby thread number. If the maximum 

10 running thread number is greater than the standby thread 

number, the thread termination circuit 12 returns to step 

f*j S51. If the standby thread number is greater than the 

^ maximum running thread number, the thread termination 
NJ 

J£ circuit 12 proceeds to step S53. 

fn 

Jrt 15 At step S53, the thread termination circuit 12 

Cfl requests termination of a standby thread (writes a 

l~ termination request to the thread terminating ECB 24b of the 

! s 

thread control list corresponding to the standby thread) to 
fy terminate the standby thread and recover memory resources. 

*~ 20 The multithreading controller 1 may also be embodied 

C3 in a computer program executed by a computer. Fig. 6 shows 

a computer 60, which performs multithreading to run programs 
in parallel. The computer 60 includes a processor 61, an 
input/output device 62, a main memory 63, and an auxiliary 
2 5 memory 64 . 

The computer program is stored in a portable storage 
medium 65, such as a floppy disk or a CD-ROM. 

Alternatively, the computer program may be stored in a main 
memory or an auxiliary memory of another network-connected 
30 computer. 

The computer program is loaded to the main memory 63 
of the computer 60 after the computer program is temporarily 
copied or installed to the auxiliary memory 64 from the 
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storage medium 65. Alternatively, the computer program is 
loaded directly to the main memory 63 from the storage 
medium 65. Afterward, the program is executed. 

The thread management table 13 of Fig. 1 is generated in 
5 the main memory 63, and the thread management table 13 

manages thread information. 

Further, when a computer program is provided from 
another device that is connected to a network, the program 
is first received via the network from the device. The 
10 program is then either directly stored in the main memory 63 

or temporarily copied or installed in the auxiliary memory 
3 64 and then loaded to the main memory 63. Afterward, the 

^ program is run. 

S The devices 61-64 shown in Fig. 6 may be replaced by 

0 

q 15 elements that perform the same function when the computer 

program is run. Further, the computer program may be used 
in a system having a plurality of each of the devices 61-64. 
Additionally, the computer program may be used in a loosely- 



fU " coupled or tightly-coupled computer system. 

m 

20 The multithreading controller 1 has the advantages 



described below. 

(1) The thread termination circuit 12 of the 
multithreading controller 1 monitors the number of running 
threads over a predetermined time period and compares the 

25 maximum value obtained during the time period (maximum 

running thread number) with the standby thread number. When 
the standby thread number is greater than the maximum 
running thread number, the surplus standby threads, the 
number of which exceeds the maximum running thread number, 

30 are terminated. This recovers the system resources that 

were used insufficiently by the standby threads and 
decreases the effects on the running threads of such surplus 
standby threads . 
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(2) The thread termination circuit 12 keeps a number 
of standby threads corresponding to the value of the maximum 
running thread counter section 21e, or the maximum number of 
standby threads corresponding to the number running threads 
5 obtained during the predetermined time, and terminates the 

remaining, surplus standby threads. The maximum running 
thread number varies in accordance with the state of the 
running programs, or the operational state of the system. 
Since the standby threads are terminated in accordance with 
10 the changes in the maximum running thread number, the 

necessary number of standby threads are ensured in 
p accordance with the operational state of the system. 

y% It should be apparent to those skilled in the art that 

*P the present invention may be embodied in many other specific 

Ely 

fr? 15 forms without departing from the spirit or scope of the 
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invention. Particularly, it should be understood that the 
present invention may be embodied in the following forms. 

The value of the standby thread counter section 21c 



ru 

ftj may be the currently necessary number of standby threads. 

CO 

q 20 In this case, standby threads may be terminated based on a 

^ comparison between the value of the standby thread counter 

section 21c and the value of the running thread counter 
section 21d. Alternatively, an average value of the number 
of the running threads during a predetermined time period 
25 may be obtained as the necessary number of standby threads. 

In this case, standby threads are terminated based on a 
comparison between the average value and the current number 
of running threads until the number of the standby threads 
decreases to the average value or the present running thread 
30 number. 

The necessary number of standby threads may be 
obtained by multiplying the running thread number by a 
coefficient, which is a fixed value or a value obtained in 
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accordance with the state of the system. In this case, 
standby threads are terminated until the number of standby 
threads decreases to the necessary number. 

The thread management circuit 11 or the thread 
5 termination circuit 12 may be configured to update the value 

of the maximum running thread counter section (maximum 
running thread counter section 21e) . 

The present examples and embodiments are to be 
considered as illustrative and not restrictive, and the 
10 invention is not to be limited to the details given herein, 

but may be modified within the scope and equivalence of the 
appended claims. 
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